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Abstract 

We present a logical framework to represent 
and reason about stochastic optimization prob- 
lems based on probability answer set program- 
ming |Saad and Pontelli, 2006[ |Saad, 2006[ 



|Saad, 2007a| . This is established by allowing 
probability optimization aggregates, e.g., 
minimum and maximum in the language of 
probability answer set programming to allow 
minimization or maximization of some desired 
criteria under the probabilistic environments. 
We show the application of the proposed 
logical stochastic optimization framework 
under the probability answer set programming 
to two stages stochastic optimization problems 
with recourse. 



1 Introduction 

Probability answer set programming 

|Saad and Pontelli, 2006[ |Saad, 2006| [Saad, 2007a 



declarative programming framework which aims to solve 
hard search problems in probability environments, and 
shown effective for probability knowledge representation 
and probability reasoning applications. It has been 
shown that many interesting probability reasoning prob- 
lems are represented and solved by probability answer 
set programming, where probability answer sets describe 
the set of possible solutions to the problem. These 
probability reasoning problems include, but not limited 
to, reasoning about actions with probability effects and 
probability planning Saad, 2007b|, reinf orcement learn- 
ing in MDP environments Saad, 2008a|, reinfo rcement 
learning in POMDP environments Saad, 20TT], contin- 



gent prob ability planni ng |Saad, 2009 
reasoning [Sa ad, 2008b 



and Bayesian 



However, the unavailability 
of probability optimization aggregates, e.g., minimum 
and maximum in the language of probability answer 
set program ming Saa d and Pontelli, 2006| |Saad, 2006 



|Saad, 2007a| disallows the natural and concise repre- 
sentation of many interesting stochastic optimization 
problems that are based on minimization and maximiza- 
tion of some desired criteria imposed by the problem. 



The following stochastic optimization with recourse 
problem illuminates the need for these aggregates. 

Example 1 Assume that a company produces some 
product, G, and need to make a decision on the amount 
of units of G to produce based on the market demand. 
The company made a decision on the amounts of units 
of product G to produce at cost of $2 per unit of G (first 
stage). However, market demand is stochastic with a 
discrete probability distribution and the market demand 
must be met in any scenario. The company can produce 
extra units of product G to meet the market observed 
demands but with the cost of $3 per unit (second stage). 
This means a recourse to extra production to meet the ex- 
cess in demand. Assume that the probability distribution, 
Pi, over market demand, Di, is given as follows where 
two scenarios are available, D\ — 500 with p\ — 0.6 and 
Z?2 = 700 with pi = 0.4. Formally, let x be the number 
of units of product G the company produces at the first 
stage and let yi, called recourse variable, be the num- 
ber of units the company produces at the second stage to 
meet the market stochastic demand at scenario i. The 
objective is to minimize the total expected cost. This 
two stages stochastic optimization problem is formalized 
as: 



subject to 



minimize 2x 



x + yi> D { 

x>0 
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where the constraint x + yi > Di guarantee that demand 
is always met in any scenario and 1 = 2. The optimal 
solution to this two stages stochastic optimization with 
recourse problem is x = 500, y\ — 0, yi — 200, and with 
minimum total expected cost equal to $1240. 

To represent this stochastic optimization problem in 
probability answer set programming and to provide cor- 
rect solution to the problem, the probability answer set 
programming representation of the problem has to be 
able to represent the probability distributions of the 
problem domain and any probability distribution that 



may arise to the problem constraints along with the 
preference relation that minimizes or maximizes the ob- 
jective function including the expected values that al- 
ways appear in the objective functions of these types of 
stochastic optimization problems, and to be able to com- 
pare for the minimum or the maximum of the objective 
value across the generated probability answer sets. 

However, the current syntax and semantics of prob- 
ability answer set programming do not define proba- 
bility preference relations or rank probability answer 
sets based on minimization or maximization of some 
desired criterion specified by the user. Therefore, in 
this paper we extend probability answer set program- 
ming with probability aggregate preferences to allow 
the ability to represent and reason and intuitively solve 
stochastic optimization problems. The proposed prob- 
ability aggregates probability answer set optimization 
framework presented in this paper modifies and gener- 
alizes the classical aggregates classical answer set opti- 
mization presented in |Saad and Brcwka, 2011 as well 
as the classical answer set optimization introduced in 
[Brewka et al., 2003 . We show the application of proba- 
bility aggregates probability answer set optimization to a 
two stages stochastic optimization with recourse problem 
described in Example ([TJ, where a probability answer 
set program |Saad, 2007a| (disjunctive hybrid probabil- 
ity logic program with probability answer set semantics) 
is used as probability answer sets generator rules. 

2 Probability Aggregates Probability 
Answer Set Optimization 

Probability answer set optimization programs are prob- 
ability logic programs under the probability answer set 
semantics whose probability answer sets are ranked ac- 
cording to probability preference rules represented in the 
programs. A probability answer set optimization pro- 
gram, n, is a pair of the form 

II = (Rgen U Rpref , t) j where R gen U R pre f is a union of 
two sets of probability logic rules and r is a mapping, 
r : Be — >• Sdisj , associated to the set of probability logic 
rules R gen . The first set of probability logic rules, R ge n, 
is called the generator rules that generate the probabil- 
ity answer sets that satisfy every probability logic rule 
in Rg e n and the mapping r associates to each atom, a, 
appearing in R gen , a disjunctive p-strategy that is used 
to combine the probability intervals obtained from dif- 
ferent probability logic rules in R gen with an atom a 
appearing in their heads. R gen is any set of probabil- 
ity logic rules with well-defined probability answer set 
semantics including normal, e xtended, and disjunctive 
hybrid probability logic rules |Saad and Pontelli, 2006| 
|Saad, 20061 |Saad, 2007a| , as well as hybrid probability 
logic rules with probability aggregates (all are forms of 
probability answer set programming). 

The second set of probability logic rules, R pre f, is 
called the probability preference rules, which are prob- 
ability logic rules that represent the user's probability 
quantitative and qualitative preferences over the proba- 



bility answer sets generated by R gen - The probability 
preference rules in R pre f are used to rank the generated 
probability answer sets from R gen from the top preferred 
probability answer set to the least preferred probabil- 
ity answer set. Similar to Bre wka et al., 2003] , an ad- 
vantage of probability answer set optimization programs 
is that Rg en and R pre f are independent. This makes 
probability preference elicitation easier and the whole 
approach is more intuitive and easy to use in practice. 

In our introduction of probability answer set optimiza- 
tion programs, we focus on the syntax and semantics 
of the probability preference rules, R pre f, of the proba- 
bility answer set optimization programs, since the syn- 
tax and semantics of the probability answer sets gen- 
erator rules, Rgen, are the same as syntax and se- 
mantics of any set of probability logic rules with well- 
defined probability answer set semantics as described in 
Saad and Pontelli, 2006]|Saad, 20061 |Saad, 2007a| . 



2.1 Basic Language 

Let C be a first-order language with finitely many predi- 
cate symbols, function symbols, constants, and infinitely 
many variables. A literal is either an atom a in Be 
or the negation of an atom a {-<a), where Be is the 
Herbrand base of C and -i is the classical negation. 
Non-monotonic negation or the negation as failure is 
denoted by not. The Herbrand universe of C is de- 
noted by U c- Let Lit be the set of all literals in L, 
where Lit — {a \ a e Be} U {->a \ a G Be}- A prob- 
ability annotation is a probability interval of the form 
[ai,a2], where ct\,cti are called probability annotation 
items. A probability annotation item is either a con- 
stant in [0, 1] (called probability annotation constant), a 
variable ranging over [0, 1] (called probability annotation 
variable), or f(ot\, . . . , a n ) (called probability annotation 
function) where / is a representation of a monotone, 
antimonotone, or nonmonotonc total or partial function 
/ : ([0, 1])" — > [0, 1] and a\, . . . ,a n are probability an- 
notation items. 

Let S = SconjUSdisj be an arbitrary set of p- 
strategies, where S CO nj (Sdisj) is the set of all conjunctive 
(disjunctive) p-strategies in S. A hybrid literals is an ex- 
pression of the form l\ A p . . .A p l n or liV p > . . .V p >l n , where 
li, . . . , l n are literals and p and p' are p-strategies from 
S. bfs(Lit) is the set of all ground hybrid literals formed 
using distinct literals from Lit and p-strategies from S. 
If L is a hybrid literal p is a probability annotation then 
L : p, is called a probability annotated hybrid literal. 

A symbolic probability set is an expression of the form 
{X : [Pi,P 2 ] | C}, where A is a variable or a func- 
tion term and Pi, P 2 are probability annotation vari- 
ables or probability annotation functions, and C is a 
conjunction of probability annotated hybrid basic for- 
mulae. A ground probability set is a set of pairs of the 
form (x : [pi,P2] | C 9 ) such that a; is a constant term 
and p\,P2 are probability annotation constants, and C 9 
is a ground conjunction of probability annotated hybrid 
basic formulae. A symbolic probability set or ground 
probability set is called a probability set term. Let / 



be a probability aggregate function symbol and S be 
a probability set term, then f(S) is said a probability 
aggregate, where / G { vclIe, sums, timesE, miriE, 
maxE, count e, sump, times p, minp, maxp, count p 
}. If f(S) is a probability aggregate and T is an interval 
[#i, 62], called guard, where 9\, 9 2 are constants, variables 
or functions terms, then we say f(S) -< T is a probability 
aggregate atom, where -<G {=, 7^, <, >, <, >}. 

A probability optimization aggregate is an expres- 
sion of the form maXu(f(S)), min fl (f(S)), max x (f(S)), 
min x (f(S)), max x ^(f(S)), and min xfi (f(S)), where / 
is a probability aggregate function symbol and S is a 
probability set term. 

2.2 Probability Preference Rules Syntax 

Let A be a set of probability annotated hybrid liter- 
als, probability annotated probability aggregate atoms 
and probability optimization aggregates. A boolean 
combination over A is a boolean formula over proba- 
bility annotated hybrid literals, probability annotated 
probability aggregate atoms, and probability optimiza- 
tion aggregates in A constructed by conjunction, dis- 
junction, and non-monotonic negation (not), where non- 
monotonic negation is combined only with probabil- 
ity annotated hybrid literals and probability annotated 
probability aggregate atoms 

Definition 1 A probability preference rule, r, over a set 
of probability annotated hybrid literals, probability an- 
notated probability aggregate atoms and probability opti- 
mization aggregates, A, is an expression of the form 

C\ y C<i y . . . y Ck <r- L^+i ■ m/m-i, ■ • • , L m ■ m™, 

not L m+ i : n m+1 , . . . ,not L n : u n (1) 

where Lk+\ : (J-k+l , • • . , L n : fj, n are probability anno- 
tated hybrid literals and probability annotated probability 
aggregate atoms and C\,C 2 , . . . ,Ck are boolean combi- 
nations over A. 

Let body{r) = L k+1 : u k+1 ,...,L m : n m ,not L m+1 : 
/i m+ i, . . . , not L n : \x n and head(r) = C\ y C 2 y ■ ■ ■ y 
Ck , where r is a probability preference rule of the form 
([T]). Intuitively, a probability preference rule, r, of the 
form (fTJ) means that any probability answer set that sat- 
isfies body(r) and C\ is preferred over the probability 
answer sets that satisfy body(r), some Cj (2 < i < k), 
but not C\ , and any probability answer set that satisfies 
body(r) and Ci is preferred over probability answer sets 
that satisfy body(r), some Ci (3 < i < k), but neither 
C\ nor C2, etc. 

Definition 2 A probability answer set optimization pro- 
gram, II, is a pair of the form II = (R gen U i? pre /,r}, 
where R gen is a set of probability logic rules with well- 
defined probability answer set semantics, the generator 
rules, Rpref is a set of probability preference rules, and 
t is the mapping r : Lit —¥ Sdisj that associates to each 
literal, I, appearing in R gen a disjunctive p-strategy. 

Let f{S) be a probability aggregate. A variable, X, is a 
local variable to f(S) if and only if X appears in S and 



X does not appear in the probability preference rule that 
contains f(S). A global variable is a variable that is not 
a local variable. Therefore, the ground instantiation of 
a symbolic probability set 

S={X:[P 1 ,P 2 ]\C} 

is the set of all ground pairs of the form (8 (X) : 
[6 (Pi), 9 (P 2 )] I 9 (C)>, where 9 is a substitution of ev- 
ery local variable appearing in S to a constant from Uc- 
A ground instantiation of a probability preference rule, 
r, is the replacement of each global variable appearing 
in r to a constant from Uc , then followed by the ground 
instantiation of every symbolic probability set, S, ap- 
pearing in r. The ground instantiation of a probability 
aggregates probability answer set optimization program, 
II, is the set of all possible ground instantiations of every 
probability rule in II. 

Example 2 The two stages stochastic optimization with 
recourse problem presented in Example (Qp can be repre- 
sented as a probability aggregates probability answer set 
optimization program II = {R gen U R pre f , 7") , where r is 
any assignments of disjunctive p-strategies and R gen is a 
set of disjunctive hybrid probability logic rules with prob- 
ability answer set semantics \Saad, 2 007a) of the form: 

domX(500) V domX(550) V domX(600) V domX(650)V 

domX (700). 

domYi(O) : pi V domY x (50) : pi V cZotoYi(IOO) : p x V 

domYi(150) : pi V domY^OO) : pi. 

domY 2 (0) : p 2 V domY 2 (50) : p 2 V domY 2 (100) : p 2 V 

domY 2 (150) : p 2 V domY 2 (200) : p 2 . 

objective(X, Y\, Y 2 , 2 * X + 3 * p\ *Y\ + 3 * p 2 * Y 2 ) 

4- domX(X),domY 1 (Yi) : p 1; 

domYi(Y 2 ) : p 2 . 

<- domX(X),domY 1 (Y 1 ):p l ,X + Y 1 < 500. 

<- domX{X),domY 2 (Y 2 ) :p 2 ,X + Y 2 < 700. 

where p\ = 0.6 and p 2 = 0.4, domX(X), domYi(Y\), 
domY 2 {Y 2 ) are predicates represent the domains of pos- 
sible values for the variables X, Y%, Y 2 that represent the 
units of product G corresponding to the variables x, j/i, y 2 
described in Example (J^l, objective(X,Yi,Y 2 ,Cost) is a 
predicate that represents the objective value, Cost, for 
the assignments of units of a product G to the variables 
X, Y\, Y 2 where Cost is the expected cost for this as- 
signment of variables. 

The set of probability preference rules, R pre f, of H 
consists of the probability preference rule 

min x {Cost : 1 | objective(X,Y\,Y 2 , Cost)} <— 



3 Probability Aggregates Probability 
Answer Set Optimization Semantics 

Let X denotes a set of objects. Then, we use 2 X to denote 
the set of all multisets over elements in X. Let C[0, 1] 
denotes the set of all closed intervals in [0, 1], R denotes 



the set of all real numbers, N denotes the set of all nat- 
ural numbers, and Uc denotes the Hcrbrand universe. 
Let _L be a symbol that does not occur in C. Therefore, 
the semantics of the probability aggregates are defined 
by the mappings: 

• val E :2 mxC ^^^[R,R}. 

• sum E : 2 RxC [°< 1 ] -> [R,R]. 
. timesE : 2 RxC [°> 1 l -> [R,R]. 

• min E ,max E : (2 RxC [°> 1 l - 0) -)• [R,R]. 

• counts :2^ xC [°- 1 ] -► [R,M]. 

• sump : 2 RxC [°> 1 l -4txC[0,l]. 

• timesp : 2 RxC [°> 1 l -4lx C[0, 1]. 

. min P , maxp : (2 RxC [°' 1 l - 0) -> R x C[0, 1]. 

• countp : 2< 7cxC [°< 1 ] -> N x C[0, 1]. 

The application of surriE and times e on the empty mul- 
tiset return [0,0] and [1. 1] respectively. The application 
o£vciIe and count e on the empty multiset returns [0,0]. 
The application of sump and times p on the empty mul- 
tiset return (0, [1, 1]) and (1, [1, 1]) respectively. The 
application of countp on the empty multiset returns 
(0, [1, 1]). However, the application of maxE, minE, 
maxp, minp on the empty multiset is undefined. 

The semantics of probability aggregates and proba- 
bility optimization aggregates in probability aggregates 
probability answer set optimization is defined with re- 
spect to a probability answer set, which is, in general, 
a total or partial mapping, ft, from bfs(Cit) to C[0, 1]. 
In addition, the semantics of probability optimiza- 
tion aggregates max ^{j \S)) , min ll {f{S)), max x (f(S)), 
min x (f(S)), max Xfl (f(S)), and ram I(1 (/(S)) are based 
on the semantics of the probability aggregates f(S). 

We say, a probability annotated hybrid literal, Lu, 
is true (satisfied) with respect to a probability answer 
set, ft, if and only if u < h(L). The negation of a 
probability hybrid literal, not L : fi, is true (satis- 
fied) with respect to ft. if and only if a ^ h(L) or L 
is undefined in ft. The evaluation of probability aggre- 
gates and the truth valuation of probability aggregate 
atoms with respect to probability answer sets are given 
as follows. Let f(S) be a ground probability aggregate 
and ft be a probability answer set. In addition, let Sh 
be the multiset constructed from elements in S, where 
S h = lx : [pi.pa] | (x : [ Pl ,p 2 ] | C) e SA & is true 
w.r.t. ft]}. Then, the evaluation of f(S) with respect 
to h is, f(Sh), the result of the application of / to Sh, 
where f{Sh) = _L if Sh is not in the domain of / and 

• val E (S h ) = Ex:bi, P 2]eSh (* x [Pi.Pa]) 

• SUm E {S h ) = (Ex:bi,P2]€S„ x ) x 



• min E {Sh) = 
(rL:[ Pl , P2 ]es h [P1.P2. 

• max E (S h ) = 
(U X :\p u p 2 ]eS h [Pi.K 

• count E(Sh) = 

(Hx:\puP2]ZS h \PUP2. 



m[n x:[ Pl , P2 ]es h x) 
max x:[ p 1)P2]eSft x) 
C0Mnt x:[pi)P2 ] eSfc x) 



(Hx:[ Pl ,p 2 ]es h [P1.P2]) 
• times E (S h ) = (I\ X : [pi , P2 ]es h 

(Hx:l P l,P2]eS h [P1.P2]) 



,;) 



• sutop^) - (Ex:bi, P 2]eSh x ' rL:[ Pl , P2]e s h [P1.P2]) 

• times P (S h ) = (IL : [ Pl ,p 2 ] e s h x . nx:[pi,P2]eS h [P1.P2]) 

• min P {S h ) = (min :r:[pi!P2]eSh x , ELb^leS* [Pi>P2]) 

• max P {S h ) = (max x:[piiP2]eSh x , IL : [ Pl ,p 2 ]es h [P1.P2]) 

• count P (S h ) = (count x:[puP2]eSh x , ELbi^leS,, fci'Pa] 

3.1 Probability Preference Rules 
Semantics 

In this section, we define the notion of satisfaction of 
probability preference rules with respect to probabil- 
ity answer sets. We consider that probability anno- 
tated probability aggregate atoms that involve probabil- 
ity aggregates from {vciIe, suwle, timesE, minE, maxE, 
count e} are associated to the probability annotation 

[1,1]. 

Let LI = (R gen U Rpref , t) be a ground probability 
aggregates probability answer set optimization program, 
ft, ft' be probability answer sets for R gen (possibly par- 
tial), / e {valE, sutue, timesE, minE, maxE, counts} 
and g £ {sump, times p, minp, maxp, countp}, and 
r be a probability preference rule in R pre f. Then the 
satisfaction of a boolean combination, C , appearing in 
head{r), by ft is defined inductively as follows: 

• ft satisfies L : u iff \x < h(L). 

• ft satisfies not L : fj, iff \x ^ h(L) or L is undefined 
in ft. 

• h satisfies f(S) -< T : [1, 1] iff f(S h ) ^ _L and 
f(S h ) <T. 

• ft satisfies not f(S) ~< T : [1,1] iff f(S h ) = _L or 
f(S h ) + J- and f(S h ) ^ T. 

• ft satisfies g(S) -< T : a iff g(Sh) — (x, v) ^- _L and 
a; -< T and /1 < t ^. 

• ft, satisfies not S'(iS') -< T : /j, iff g(Sh) = -L or 

g(Sh) = {x, v) 7^ _L and 1 / T or /i ^ t v. 

• /i satisfies max(f(S)) iff f(Sh) =i/l and for any 
ft', /(SV) = a;' 7^ -L and x' < x or /(5 ft ) 7^ _L and 
/(5fc0 = J- 

• ft satisfies min(f(S)) iff f(5ft) = x ^ _L and for 
any ft', /(S fc ,) = x' ^ ± and x < x' or /(5ft) ^ JL 
and /(Sfc/) = -L- 



• ft satisfies max^(g(S)) iff g(Sh) = (x, v) 7^ _L and 
for any ft', g(Sh') = (x',i/) 7^ -L and 1/ < z/ or 
ff(5 fc )^±andff(Sfc/) = J- 

• ft satisfies min^(g(S)) iff g(Sh) = (x,v) 7^ _L and 
for any ft,', g(Sh') = (x',2/) / _L and v < v' or 
ff (5 fc )^±andff(Sfc/) = ±. 

• ft satisfies max x {g{S)) iff g(Sh) — {x,v) 7^ _L and 
for any ft', g(Sh>) = (x',t/) 7^ J- and x' < x or 
g(S h ) ^ ± <md g(S h ,) = ±. 

• ft satisfies min x (g(S)) iff g(Sh) = (x, i 7 ) 7^ -L and 
for any ft', g{Sh') = (x',v') 7^ _L and x < x' or 
ff(5 fc )^±andff(Sfc/) = -L- 

• ft satisfies max x ^(g(S)) iff g(Sh) = (x, z^) 7^ _L and 
for any ft', g(Sh') = (x',i>') 7^ _L and x' < x and 
i'' < v or ff (5 fc ) 7^ J- and g(S h >) = _L 

• ft satisfies min xtl {g{S)) iff g(Sh) — {x,v) 7^ _L and 
for any ft', g(Sh>) — (x',j/) 7^ _L and x < x' and 
v < v' or g(Sh) 7^ -L and g(Sh') = -L. 

• ft f= Ci A C 2 iff ft h Ci and & H C2- 

• ft h Ci V C 2 iff ft h Ci or ft |= C* 2 . 

The satisfaction of body(r) by ft is defined inductively as 
follows: 

• ft satisfies L : \i iff u < h(L). 

• ft satisfies not L : ji iff u ^ ft(£) or L is undefined 
in ft. 

• ft satisfies f(S) -< T : [1, 1] iff f(S h ) ^ _L and 
/(Sfc) -< T. 

• ft satisfies not f(S) -< T : [1,1] iff /(Sh) = _L or 
/(S h ) 7^ JL and /(5 fc ) ^ T. 

• ft satisfies g(5) -< T : \x iff <7(S/i) = (x, v) ^ ±_ and 
x -< T and u < t za 

• ft satisfies not g(5) -< T : \x iff g(Sh) = _L or g(Sh) = 
(x, j/) 7^ _L and x -fi T or /1 j£ 4 v. 

• ft satisfies body(r) iff V(fc + 1 < i < m), ft satisfies 
Li : Hi and V(m + 1 < j < n) , ft satisfies not Lj : /Uj . 

The application of the probability aggregates, / € 
{v al e , sum e , time e, min e, max e}, on a singleton {x : 
/i}, returns x.fi (x multiplied by /1), i.e., /({x : /1}) = 
x.u. Therefore, we use max(S) and min(S) as ab- 
breviations for the probability optimization aggregates 
max(f(S)) and min(f(S)) respectively, whenever S is a 
singleton and / € {v alE, sum e, time E,rninE,rnaXE}- 
Similarly, the application of the probability aggre- 
gates, g S {sum p, time p, min p, max p}, on a sin- 
gleton {x : «}, returns (x,/i), i.e., /({x : u}) = 
(x,u). Therefore, we use max^(S), min^{S), max x (S), 
min x (S), max xlx (S), and min xfi (S) as abbreviations 
for the probability optimization aggregates max^(g(S)), 
min,j,(g{S)), max x (g(S)), min x (g(S)), max xfi {g(S)), 
and min xti (g(S)) respectively, whenever S is a single- 
ton and g € {sum p , time p, min p, max p}. 



Definition 3 Let II = {R gen U i? pre /,T) 6e a ground 
probability aggregates probability answer set optimization 
program, ft be a probability answer set for R gen , and r be 
a probability preference rule in R pre f , and Ci be a boolean 
combination in head(r). Then, we define the following 
notions of satisfaction of r by ft: 

• h \=i r iff h \= body(r) and h\= Ci. 

• ft \=irr r iff h \= body(r) and ft does not satisfy any 
C'i in head(r). 

• ft \=irr T iff h does not satisfy body(r). 

ft \=i r means that the body of r and the boolean com- 
bination Ci that appearing in the head of r is satisfied 
by ft. However, ft \=i rr r means that r is irrelevant (de- 
noted by irr) to ft, or, in other words, the probability 
preference rule r is not satisfied by ft, because either one 
of two reasons. Either because the body of r and non 
of the boolean combinations that appearing in the head 
of r are satisfied by ft. Or because the body of r is not 
satisfied by ft. 

3.2 Probability Answer Sets Ranking 

In this section we define the ranking of the probability 
answer sets with respect to a boolean combination, a 
probability preference rule, and with respect to a set of 
probability preference rules. 

Definition 4 Let II = (R gen U R pre f,r) be a ground 
probability aggregates probability answer set optimization 
program, fti,ft.2 be two probability answer sets for R gen , 
r be a probability preference rule in R pre f , Ci be boolean 
combination appearing in head(r), and f G {valE, 
suiriE, times e, minE, maxE, count e} and g € {sump, 
timesp, minp, maxp, countp}. Then, fti is strictly 
preferred over ft 2 w.r.t. Ci, denoted by hi >-, ft 2 , iff 
fti |= Ci and ft 2 V- Ci or h\ \= Ci and ft 2 |= Ci (except 
Ci is a probability optimization aggregate) and one of the 
following holds: 

• Ci = L : /i implies fti >-j ft 2 iff hi (L) > ft 2 (X). 

• Ci = not L : fi implies hi )~i ft 2 iff fti(X) < ft 2 (L) 
or L is undefined in hi but defined ft 2 . 



Ci = f(S) ~< T : [1, 1] implies hi r . ,, 
if^l, f(Sh 2 ) = x' 7^ _L, and x' < x. 



hi >-i ft 2 iff f {Shi) = 

-J- _1_, LilljU X *\ X. 

• Ci = not f(S) -< T : [1, 1] implies hi >-i ft 2 iff 
1 = _L ant 



- fiSht) = -L and f(S h2 ) ^ L or 

= i^l, f(Sh 2 ) = x ' 7^ ^; an d x < x' 



Ci = g(S) -< T : jj, implies hi >-, ft 2 iff g(Sh 1 ) = 
(x, v) 7^ _L, g(Sh 2 ) — (x', v') 7^ _L, and v' < v. 

Ci = not g(S) -<T : h implies hi >-; ft 2 iff 

- g{Shi) = J- and g{S h2 ) 7^ _L or 

- g(S h i) = (x,v) 7^ _L, g(S h2 ) = (x',!/') 7^ _L, 
anrf v <v' 



Ci G {max(f(S)), min(f(S)),max li (g(S)), min li ,{g{S)), 
max x (g(S)),min x (g(S)),max Xfi (g(S)), min xpi (g(S))} 
implies hi >-$ hi iff hi h Ci and hi ¥- Ci. 



• Ci — Ci x A Ci 2 implies hi >-, hi iff there exists 
t G {*i,*2} such that hi )~ t hi and for all other 
t' G {ii, ii\, we have hi >zt> hi. 

• Ci = Ci t V Ci 2 implies hi Xj hi iff there exists 
t G {^11*2} such that hi )~ t hi and for all other 
t' G {ii,ii}, we have hi ^t< hi. 

We say, hi and hi are equally preferred w.r.t. Ci, de- 
noted by hi —i hi, iff hi ¥■ Ci and hi Y- Ci or hi \= Ci 
and hi h Ci and one of the following holds: 

• Ci = L : fi implies hi —i hi iff hi(L) — hi(L). 

• Ci = not L : fi implies hi —i hi iff hi(L) — h 2 (L) 
or L is undefined in both hi and hi. 

• C'i = f(S) -< T : [1, 1] implies hi =. t h 2 iff f{S hl ) = 
x h _L, f(Sh 2 ) = x' h _L, and x' = x. 

• Ci = not f(S) ~< T : [1, 1] implies hi —i hi iff 

- f(S hl ) = 1 and f(Sh 2 ) = ± or 

- f(S hl ) = f(S h2 )^± 

• Ci = g(S) -< T : fj, implies hi =i h 2 iff g{S hl ) = 
{x,v) h -L, g(Sh 2 ) — {x',v') 7^ _L, and v' = v. 

• Ci = not g(S) ~< T : [i implies hi =i hi iff 

- diSin) = -L and g(S h2 ) = _L or 

- g(S hl ) = [x,v) ± ±, g(S h2 ) = {x',u') * L, 
and v = v' 

• Ci G {max(f(S)), min(f(S)),max fJ ,{g(S)), 
min f _ l (g(S)),max x (g(S)),min x (g(S)),max xfl (g(S)), 

hi iff hi |= Ci and 



Tnin X n(g(S))} implies hi 

hi ha 



C t = 

\{hi 



Ci x A Ci 2 implies hi 



hi iff 
\ft G {ii, i 2 }, hi = t h 2 

hi iff 

t h 2 \Vt G {ii,n}}\ = \{h 2 ht hi\Vt G {*i,i 2 }}| 

de- 



Ci x V Ci 2 implies hi 



>- 



We say, hi is at least as preferred as hi w.r.t. Ci 
noted by hi >Zi hi, iff hi >-j hi or hi =j hi. 

Definition 5 Let II = (R gen U R pre f,r) be a ground 
probability aggregates probability answer set optimization 
program, hi, hi be two probability answer sets for R gen , 
r be a probability preference rule in R pre f, and Ci be a 
boolean combination appearing in head(r). Then, hi is 
strictly preferred over hi w.r.t. r, denoted by hi )~ r hi, 
iff one of the following holds: 

• hi hi T and hi hj r and i < j , 

where i = min{Z | hi \=i r} and j — min{Z | hi \=i 
r}. 



hi \=i r and hi hi r an d hi y-i hi, 

where i = min{Z | hi hi r} = min{/ | hi \=i r}. 

hi hi r an d hi hirr f- 



We say, hi and hi are equally preferred w.r.t. r, denoted 
by hi = r hi, iff one of the following holds: 

• hi hi r an d hi hi t and hi —i hi, 

where i — min{Z | hi hi t} — min{/ | hi hi ?'}■ 

• hi hirr T and hi hirr T. 

We say, hi is at least as preferred as hi w.r.t. r, denoted 
by hi > r hi, iff hi )~ r hi or hi = r h%. 

The previous two definitions characterize how probabil- 
ity answer sets are ranked with respect to a boolean 
combination and with respect to a probability preference 
rule. Definition Q presents the ranking of probability 
answer sets with respect to a boolean combination. But, 
Definition (|5|) presents the ranking of probability answer 
sets with respect to a probability preference rule. The 
following definitions specify the ranking of probability 
answer sets according to a set of probability preference 
rules. 

Definition 6 (Pareto Preference) Let II = (R gen U 
Rpref ,t) be a probability aggregates answer set optimiza- 
tion program and hi, hi be probability answer sets of 
Rgen- Then, hi is (Pareto) preferred over hi w.r.t. 
Rpref, denoted by hi ^R prcf hi, iff there exists at 
least one probability preference rule r G R pre f such that 
hi >- r hi and for every other rule r' G R pre f, hi y r i h%. 
We say, hi and hi are equally (Pareto) preferred w.r.t. 
Rpref, denoted by hi —R prcJ hi, iff for all r G R pre f, 
hi = r hi. 



Definition 7 (Maximal Preference) Let II = 

{Rgen U Rpref , t) be a probability aggregates probability 
answer set optimization program and hi, hi be prob- 
ability answer sets of R gen - Then, hi is (Maximal) 
preferred over hi w.r.t. R pre f , denoted by hi ^r hi, 
€ ' ' ' 

\{r G Rpref\hl hr h 2 }\ > \{r G Rpref\hl hr kl}\. 

We say, hi and hi are equally (Maximal) preferred w.r.t. 



R pr ef, denoted by hi = Rpj 

\{r G Rpref\hi hr h 2 }\ 



hi, iff 

\{r G Rpref\hl hr kl}\ 



It is worth noting that the Maximal preference defini- 
tion is more general than the Pareto preference defini- 
tion, since the Maximal preference relation subsumes the 
Pareto preference relation. 

Example 3 The generator rules, R gen , of the proba- 
bility aggregates probability answer set program, II = 
(Rgen U R pre f , t) , that represents the two stages stochas- 
tic optimization with recourse problem presented in Ex- 
ample (0), has 75 probability answer sets, where the prob- 



ability answer sets with the least total expected cost are: 

■■} 



h = {o6jeciiwe(500, 50, 200, 1330). 
h = {objective(650, 0, 50, 1360), . . 
I 3 = {objective(550, 0, 150, 1280), . 
h = {objective(55Q, 0, 200, 1340), . 
I 5 = {objective(600, 0, 100, 1320), . 
7 6 = {objective(600, 0, 150, 1380), . 
h = {objective{500, 0, 200, 1240), . 



} 



} 



The ground instantiation of the probability preference 
rule in Rpref consists of one ground probability prefer- 
ence rule, denoted by r, which is 



min x { 



...} 



: 1 


: 1 


: 1 


: 1 


: 1 


: 1 


: 1 



objective(500, 50, 200, 1330) ), 
objective(650, 0, 50, 1360) ), 
objective(550, 0, 150, 1280) ) 
objective(500, 0, 200, 1240) ) 
objective(550, 0, 200, 1340) ) 
objective(600, 0, 100, 1320) ) 
objective(600, 0, 150, 1380) ) 



Therefore, it can be easily verified that I7 \=i r and 

-*1 x^irr ^*; ^2 x^irr ^, -*3 f^irr ^,14. \=irr T, -*5 x^irr ^1 ^6 x^ir 

This implies that I7 is the top (Pareto and Maximal) 
preferred probability answer set and represents the opti- 
mal solution for the two stages stochastic optimization 
with recourse problem described in Example (QJ). The 
probability answer set I7 assigns 500 to x, to y\, and 
200 to 7/2 with total expected cost $1240, which coincides 
with the optimal solution of the problem as described in 
Example (Qp. 

4 Properties 

In this section, we show that the probability aggregates 
probability answer set optimization programs syntax and 
semantics naturally subsume and generalize the syntax 
and semantics of classical aggregates classical answer set 
optimization programs Saad and Brewka, 2011 as well 
as naturally subsume and generalize the syntax and se- 
mantics of classical answer set optimization programs 



Brewka et al., 2003 under the Pareto preference rela- 



tion, since there is no notion of Maximal preference re- 
lation has been defined for the classical answer set opti- 
mization programs. 

A classical aggregates classical answer set op- 
timization program, II C , consists of two separate 
classical logic programs; a classical answer set pro- 
gram, Rg en , and a classical preference program, R c pre i 

The first classical logic 



Saad and Brewka, 2011 



program, R c „ enJ is used to generate the classical answer 



sets. The second classical logic program, R pre t, defines 
classical context-dependant preferences that are used to 
form a preference ordering among the classical answer 
sets of R c gen . 



Any classical aggregates classical answer set op- 
timization program, IT = R c gen U R c t, can be 
represented as a probability aggregates probability 
answer set optimization program, n = (R gen U R pre f , t) , 
where all probability annotations appearing in every 
probability logic rule in R gen and all probability anno- 
tations appearing in every probability preference rule 
in R pre f is equal to [1,1], which means the truth value 
true, and r is any arbitrary mapping r : Be — > Sdisj- 
For example, for a classical aggregates classical answer 
set optimization program, IT = R c gen U Rp re t, that is 
represented by the probability aggregates probability 
answer set optimization program, n = (R gen U R pr ef > t) , 
the classical logic rule 



a\ V ... V a k <- Ofc+i, . . . , a m , not a m +i> ■■■■> n °t «n 
is in R c qen , where V(l < i < n), a% is an atom, iff 

01: [1,1] V...V a k : [1,1] ^a k+l : [1, 1], . . . , a m : [1,1], 
not a m+ i : [1,1],..., not a„ : [1, 1] 

is in Rgen- It is worth noting that the syntax and se- 
mantics of this class of probability answer set programs 
are the same as the syntax and semantics of the classi- 
cal answer set programs |Saad, 2007a| |Saad, 2 006 . In 
addition, the classical preference rule 

Ci >- C2 >-...>- C*. «- lk+i, ...,lm, not l m +i, . . . , not l n (2) 

is in Rp re t, where lk+i, • ■ • ,'n are literals and classical 
aggregate atoms and C\ , Ci , . . . , C k are boolean combi- 
nations over a set of literals, classical aggregate atoms, 
and classical optimization aggregates iff 

d y c 2 y ■ . . y c k <- i k+1 ■. [1, 1], . . . , i m ■. [1, 1], 

not l m+1 : [1, 1], . . . , not l„ : [1,1] (3) 

is in Rpref, where C\, C 2 , . . . , C k and l k+ \, ...,/„ in © 
are exactly the same as C\ , C2 , . . . , C k and l k +\ , . . . , l n in 
^ except that each classical aggregate appearing within 
a classical aggregate atom or a classical optimization ag- 
gregate in © involves a conjunction of literals each of 
which is associated with the probability annotation [1, 1], 
where [1, 1] represents the truth value true. In addition, 
any classical answer set optimization program is rep- 
resented as a probability aggregates probability answer 
set optimization program by the same way as for clas- 
sical aggregates classical answer set optimization pro- 
grams except that classical answer set optimization pro- 
grams disallows classical aggregate atoms and classical 
optimization aggregates. 

The following theorem shows that the syntax and se- 
mantics of probability aggregates probability answer set 
optimization programs subsume the syntax and seman- 
tics of the classical aggregates classical answer set opti- 
mization programs |Saad and Brewka, 2011] . 

Theorem 1 LetH= (i? gera Ui?p re /,r) be the probability 
aggregates probability answer set optimization program 
equivalent to a classical aggregates classical answer set 
optimization program, IT = R c gen U Rpref- Then, the 



,,, „ w.r.t. Rp re f under both 



preference ordering of the probability answer sets of R gen 
w.r.t. Rpref coincides with the preference ordering of 
the classical answer sets of R 
Maximal and Pareto preference relations 

Assuming that [Brewka et al., 2003| assigns the lowest 
rank to the classical answer sets that do not satisfy ei- 
ther the body of a classical preference rule or the body 
of a classical preference and any of the boolean combi- 
nations appearing in the head of the classical preference 
rule, the following theorems show that the syntax and 
semantics of the probability aggregates probability an- 
swer set optimization programs subsume the syntax and 
semantics of the classical answer set optimization pro- 
grams [Brewka et al., 2003] . 

Theorem 2 Let H = (R gen U i? pre /,r) be the proba- 
bility aggregates probability answer set optimization pro- 
gram equivalent to a classical answer set optimization 
program, IF = R c gen U R c pre t ■ Then, the preference or- 
dering of the probability answer sets of R gen w.r.t. R pre f 
coincides with the preference ordering of the classical an- 
swer sets of R gen w.r.t. Rp re f. 

Theorem 3 Let II = (R gen U i? pre /,r) be a probabil- 
ity aggregates probability answer set optimization pro- 
gram equivalent to a classical answer set optimization 
program, II C = R c qen U R c vre f- A probability answer set h 
of R gen is Pareto preferred probability answer set w.r.t. 
Rpref iff o. classical answer set L of R c qen , equivalent to 
h, is Pareto preferred classical answer set w.r.t. Rp re t- 

Theorem (|TJ) shows in general probability aggregates 
probability answer set optimization programs in addi- 
tion can be used solely for representing and reasoning 
about multi objectives classical optimization problems 
by the classical answer set programming framework un- 
der both the Maximal and Pareto preference relations, 
by simply replacing any probability annotation appear- 
ing in a probability aggregates probability answer set 
optimization program by the constant probability anno- 
tation [1,1]. Furthermore, Theorem @ shows in gen- 
eral that probability aggregates probability answer set 
optimization programs in addition can be used solely for 
representing and reasoning about qualitative preferences 
under the classical answer set programming framework, 
under both Maximal and Pareto preference relations, by 
simply replacing any probability annotation appearing 
in a probability aggregates probability answer set opti- 
mization program by the constant probability annota- 
tion [1,1]. Theorem ([3]) shows the subsumption result of 
the classical answer set optimization programs. 

5 Conclusions and Related Work 

We developed syntax and semantics of probability ag- 
gregates probability answer set optimization programs 
to represent probability preference relations and rank 
probability answer sets based on minimization or max- 
imization of some specified criteria to allow the abil- 
ity to represent and reason and solve probability opti- 
mization problems. Probability aggregates probability 



answer set optimization framework modifies and sub- 
sumes the classical aggregates classical answer set op- 
timization presented in |Saad an d Brcwk a72011| as well 
as the classical answer set optimization introduced in 
|Brewka et al., 2003) . We shown the application of prob- 
ability aggregates probability answer set optimization 
to the two stages stochastic optimization with recourse 
problem. 

To the best of our knowledge, this development is 
the first to consider a logical framework for representing 
and reasoning about optimal preferences in general in a 
quantitative and/or qualitative preferences in answer set 
programming frameworks. However, qualitative prefer- 
ences were introduced in classical answer set program- 
ming in various forms. In |Schaub and Wang, 2001] , 
preferences are defined among the rules of the logic 
program, whereas preferences among the literals de- 
scribed by the logic p rograms are introduced in 
|Sakarna and Inoue, 2000 . Answer set optimization 
(ASO) Brewk a et al., 2003 and logic progr ams with or- 



dered disjunctions (LPOD) |Brewka, 2002] are two an 
swer set programming based preference handling ap 
proaches, where context-dependant preferences are de- 
fined among the literals specified by the logic programs 
Application-dependant preferen ce handling approaches 
for planning were presented in [Son and Pontelli , 2006 



Dclgrand e et al, 2007] , where preferences among ac 

tions, states, and trajectories are defined, which are 

based on temporal logic. The major difference be 



twee n [Son and Pontelli, 2006] |Delgrande et al., 2007] 



and Brewka et al., 2003 Brewka, 2002 is that the for 



mer are specifically developed for planning, but the latter 
are application-independent. 

Contrary to the existing approaches for reasoning 
about preferences in answer set programming, where 
preference relations are specified among rules and literals 
in one program, an ASO program consists of two sepa- 
rate programs; an answer set program, P gen , and a pref- 
erence program, P pre f |Brewka et al, 2003]. The first 



program, P gen , is used to generate the answer sets, the 
range of possible solutions. The second program, P pre f, 
defines context-dependant preferences that are used to 
form a preference order among the answer sets of P gen ■ 
Probability aggregates probability answer set opti- 
mization programs distinguish between probability an- 
swer set generation, by R gen , and probability prefer- 
ence based probability answer set evaluation, by R pre f, 
which has several advantages. In particular, R pre f can 
be specified independently from the type of R gen , which 
makes preference elicitation easier and the whole ap- 
proach more intuitive and easy to use in practice. In ad- 
dition, more expressive forms of probability preferences 
can be represented in probability aggregates probabil- 
ity answer set optimization programs, since they allow 
several forms of boolean combinations in the heads of 
preference rules. 

classical answer set op- 



In Saad and Brewka, 2011 



timization programs have been extended to allow ag- 
gregate preferences. This is to allow answer set op- 



timization programs capable of encoding general op- 
timization problems and intuitive encoding of Nash 
equilibrium strategic games. The classical answer 
set optimization programs with aggregate preference 
are built on top of classical answer set optimization 
|Brewka et al., 2003] and aggregates in classical answer 



set programming Faber et al., 2010 . It has been shown 



in |Saad and Brewka, 201 1| that the classical answer set 
optimization programs with aggregate preferences sub- 
sumes the classical answer set optimization programs de- 
scribed in |Brewka et al., 2003] . 
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